Meta Unveils Llama API for AI Developers

artificial intelligence development tools

•

9 hours ago

Summary

Meta unveiled the Llama API, a tool for AI developers to explore and experiment with its AI models. The API allows developers to fine-tune and evaluate the performance of Llama models, starting with Llama 3.3 8B. Customers can generate data, train on it, and then use Meta's evaluation suite in the Llama API to test the quality of their custom model.

Key Points

The Llama API is available in limited preview and allows developers to build Llama-driven services, tools, and applications.
Developers can fine-tune and evaluate the performance of Llama models using the API.
The API offers model-serving options via partnerships with Cerebras and Groq.

Why It Matters

The Llama API's release aims to maintain Meta's lead in the open model space, as rivals threaten to upend its efforts.

Author

Kyle Wiggers

More Headlines

Meta Launches AI Chatbot App to Compete with ChatGPT

Meta has launched its AI chatbot app and API, expanding the open source ecosystem and competing with OpenAI. The company's goal is to make its models openly available, allowing developers to mix and match different models to produce what they need.

Waymo and Toyota Explore Autonomous Vehicle Platform

Waymo, the self-driving car subsidiary of Alphabet, has partnered with Toyota to explore developing an autonomous vehicle platform. The platform would be used for a robotaxi service and could also bring Waymo's technology into the next generation of Toyota vehicles sold to consumers.

Microsoft CEO says 20-30% of code is AI-generated

Microsoft CEO Satya Nadella revealed that 20-30% of the company's code is AI-generated, during a fireside chat with Meta CEO Mark Zuckerberg. The figure was shared after Zuckerberg asked roughly how much of Microsoft's code is AI-generated today. Nadella also mentioned that the company is seeing mixed results in AI-generated code across different languages.

Google's NotebookLM Now Lets You Talk to Its AI Podcast Hosts

Google's NotebookLM is an AI-based note-taking and research assistant that allows users to generate podcast with AI virtual hosts based on documents they have shared with the app. The Audio Overviews feature was launched last year, giving users the ability to digest and comprehend information in documents they have uploaded to the app.

Google Aims to Take on Duolingo with New AI Experiments

Google has released three new AI experiments aimed at helping people learn to speak a new language in a more personalized way. The experiments are designed to help users quickly learn specific phrases, sound less formal and more like a local, and use their camera to learn new words based on their surroundings.

AI Cheating Startup Cluely Goes Viral

Cluely, an AI cheating startup, has gone viral with its hidden in-browser window that can be used to cheat on everything from job interviews to exams. However, some startups are claiming they can catch Cluely's users and the company is planning to develop hardware products like smart glasses or brain chips that bypass anti-cheating software altogether.

Jared Kaplan To Speak at TC Sessions: AI

Jared Kaplan, co-founder and Chief Science Officer of Anthropic, is joining the main stage at TechCrunch Sessions: AI on June 5. He will share insights into his company's hybrid reasoning models, which balance quick responses to simple queries with deeper processing for complex problems. Additionally, he will discuss Anthropic's risk-governance framework for mitigating potential AI risks.

TechCrunch Sessions: AI

TechCrunch Sessions: AI is just around the corner, and exhibit tables are almost completely booked. If you've been considering showcasing your AI product or innovation, now's the time to commit.

Spotify Reports Q1 Results

Spotify has reported its Q1 results, which saw a 12% increase in premium subscribers to 268 million. The company also reported a record-high quarterly operating income of €509 million and total revenue jumped 15% year-over-year to €4.2 billion.

India Orders Block on Proton Mail

The Indian government has been directed to block Proton Mail, a popular email service known for its enhanced security. The decision follows a legal complaint filed by M Moser Design Associates, which alleged that employees received emails containing obscene and vulgar content sent via Proton Mail.

Meta Announces LlamaCon, Its First Generative AI Dev Conference

Meta is hosting its first-ever LlamaCon conference, aiming to showcase the latest advancements in generative AI and win over developers with its open Llama AI models. However, the company faces stiff competition from rival AI labs like OpenAI, Google, and xAI.

Meta Rolls Out AI App for Personalized Conversations

Meta has rolled out its own AI app, which allows users to access the company's AI assistant in a dedicated app. The app uses user data from Facebook and Instagram to provide personalized responses, unlike other AI assistants like OpenAI and Anthropic.

Google Announces Digital IDs for Google Wallet

Google announces that digital IDs are coming to more states and services in Google Wallet. The company also shared that Wallet is getting a way to privately verify age and that the app is expanding to 50 more countries.

Tesla Board Member Buys Stock

Tesla board member and Airbnb co-founder Joe Gebbia made a rare purchase of the company's stock, acquiring 4,000 shares worth around $1 million. This is a significant move for Gebbia, as historically, Tesla board members have either purchased options or offloaded stock.